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*h 1 Introduction 

Consider a dynamical system with random interactions (so-called a complex system in 
[9J) defined by 

x' — —kx + Ax (1-1) 
where x G M™, k is a real number and A is an n x n real random matrix with entries 

Mi = n~ l ' 2 W ir (1.2) 

The question we ask here is under what conditions on A, x is stable as n — > oo. 
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y—{ • Abstract 

Limit theorems for a linear dynamical system with random interactions are es- 
Q_i' tablished. The theorems enable us to characterize the dynamics of a large complex 



system in details and assess whether a large complex system is weakly stable or 



43 

unstable (see Definition 1 below). 
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Not surprisingly, this simple question has been extensively discussed in the literature 
and has wide applications in various areas. Early in 1972 [9], Robert May 'answered' the 
question in one of his Nature papers without proof. May's arguments are based upon the 
asymptotical behaviour of the maximal eigenvalue of the matrix A. Using results related 
to Wigner's semi-circle, he concluded that x is stable if 



provided that Wij,i,j = 1, • • • , n are i.i.d. random variables, where w is the finite stan- 
dard deviation of Wy. In a nice paper published 12 years later Cohen and Newman [2], 
after a careful investigation of various more complex situations of the matrix A, pointed 
out that May's criteria above could be false when A does not vary with n only by scaling 
(not Eq. ( 11.21) ). At the end of their paper (page 309), they emphasized that the ques- 
tion asked at the beginning of the current paper remains open. Furthermore from May's 
criteria the stability at the critical point k c = w is not clear. 

In the current paper, we aim to establish limit theorems for x and shed new lights into 
the issue discussed above. To facilitate our discussion, we first introduce some notation. 
We are interested in the statistical distribution of {xj(£)}" =1 on the real line. To study 
this distribution for any fixed time t we define a normalized counting function of Xi. 



where 6(x) is a standard Heaviside function. This function is a distribution of the random 
discrete measure on the real line. Our goal is to study the behavior of this measure in 
the limit n — > oo. More precisely, we prove that this measure becomes non-random, as 
n — > oo (i.e. the variance of J\f n (\,t) tends to zero) and the mean value coincides with 
the function 



k > w 



and unstable if 



k < w 



n 





2=1 
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This means that Af n (X, t) becomes a normal distribution with mean value a(t) and variance 
o~(t). Hence we naturally introduce the following definition. 

Definition 1 The dynamics x is (weakly) stable if and only iflimt-,^ a(t) < oo. 

We present a necessary and sufficient condition for x to be stable. When the matrix A 
has elements of i.i.d. random variables in additional to some minor restrictions, J\f n (\,t) 
converges to the normal distribution with mean a(t) = exp(— ftt) and variance 



The above results are then proved for the case of symmetric matrix A (o~(t) and a(t) take 
slightly more complex forms) and generalized to arbitrary initial conditions. 

Our proofs heavily rely on techniques recently developed in mathematical physics, in 
particular in the treatment of the Spin Glass model and the Hopfield model [7j. We first 
establish that the system we consider here has a self-average property and each single 
variable of the system is normally distributed. Based upon these properties and the 
homogeneity of the system, our proof is finally reduced to a simple calculation of the 
mean and variance of a single variable. 

The applications of our theorems could be considerably wide, in the current research 
interests of network properties arising from social science (actor networks, authors net- 
works etc.), biology (gene networks, protein networks, metabolic networks, and neuronal 
networks etc.) and computer science (internet connections) [I]. For example, we could 
directly apply our results to networks of neurons, extend our results to networks where 
the interactions have a long-tail distribution or are dependent such as in small-world net- 
works and scale-free networks. Locally, we can extend our results to nonlinear dynamics 
which exhibit more rich dynamical activities such as limit cycles and chaos [U [6] . 




(1.5) 



m=l 



where x(0) = (!,!,•••, 1). Hence x(t) is stable if and only if 



lim a(t) < oo 
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2 Results 



Let us consider the system of ordinary differential equations defined by Eq. (If .f p and 
(ll.2p with Wij satisfying conditions 

E{W ij } = 0, E{W*} = w 2 (2.1) 

and there exists a > such that 

Prob{|W i3 -| > A} < Ce~ cx \ (VA > 0) (2.2) 

Supply the system by the following initial conditions: 

x(0) = c, c= (1,...,1) E W 1 (2.3) 

Note that the solution x of the dynamics (If ,f I) obviously depends on n. We drop the 
index n whenever there is no confusion. We then have the following theorem. 

Theorem 1 Consider the system U.l\) with a matrix A of the form U.2\) under con- 
ditions Ii2.1\) and Ii2.2\) . and supply this system by the initial conditions Ii2.3\) . Then for 
any t > 0, J\f n (\,t) defined by M.'J\) converges in probability to the normal distribution 
J\f(a(t),a(t)) with the mean value 

a{t) = e~ Kt (2.4) 

and variance 



oo 



a(t) = e~*« ^ ^Tt- (2-5) 

< • mm 



m\m\ 

m=l 



Remark 1 We know that the series in the expression of o~(t) is the Bess el function and 
it behaves as exp(2wt). Therefore k c = w, where k c is the critical point of the stability of 
the dynamics ( II. Ij) . On the other hand, it is readily seen from the expression of o~(t) that 
when k = w we have lim^oo o~(t) < oo. Hence x is stable iff k c > w. 

We study also the same problem in the real symmetric case, i.e. the case when A is 
a real symmetric matrix (Aij = Aji ) of the form (If .21) and (i < j) are i.i.d. random 
variables, satisfying conditions (12.1 p and (12.21) . 



Theorem 2 Consider the system II 1.1}) with a real symmetric matrix A (Aij = Aji) 

of the form 111.2}) under conditions 112. 1\) and 112.2}) . and supply this system by the initial 

conditions 112.3}) . Then for any t > 0, A/" ra (A, t) defined by 111.3}) converges in probability to 

the normal distribution J\f(a s (t),a s (t)) (fi.^p with the mean value 

1 r 2w i 

a s (t) = / exp{-nt + Xt}V4:W 2 - X 2 d\ (2.6) 

2lTW J_ 2w 

and variance 

aJt) = / exp{-2nt+2\t}V4:W 2 - X 2 d\-( / exjp{-Kt+\tW4w 2 - \ 2 d\ ) 

2wwJ_ 2w \2ttwJ_ 2w J 

(2.7) 

Our last result is a generalizations of Theorems [I] and [2] to the case of arbitrary 
initial distribution. More precisely we study the system (11.11) in both symmetric and 
nonsymmetric cases with initial condition 

z(0) = £=(£i,...,£n), (2.8) 

where {^j}™ =1 are i.i.d. random variables independent of {Wij}™j =1 with 

E{^} = a , E{£} = wl^al E{tf} < C. (2.9) 

Theorem 3 Consider the system II 1.1}) with nonsymmetric matrix A (A^ ^ Aji) of 
the form \1.2\) under conditions \2. 1}) and $2.2}) . and supply this system by the initial 
conditions ( Q£ 8}) with $2.9\) . Then for any t > 0, Af n (\,t) defined by $1.3}) converges in 
probability to the distribution of the random variable of the form 

y{t) = e- K % + w a l / 2 {t)z (2.10) 

where z is a standard normal random variable independent of £i and a(t) is defined by 

If A in U.l\) is a real symmetric matrix (A^ = Aji) of the form 111.2}) under condi- 
tions 112.1}) and 112.2}) . then under the initial conditions 112.8}) and l}2. 9}) and for any t > 0, 
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Mn(X, t) (defined by U.3\) ) converges in probability to the distribution of the random vari- 
able of the form 

y s (t)=a s (t)^ + w Q a 1 J 2 (t)z, (2.11) 

where z is a standard normal random variable independent of £1 and a s (t) and a s (t) are 
defined by l\2.6\) and h2.5\) respectively. 

Remark 2 From results above, we see that in a sense our results are more general than 
May's criteria. We actually completely characterize the dynamical behaviour ofx, inde- 
pendent of whether it is stable or not. 



3 Proofs 

Remark 3 Let us observe that the change of variables Xi(t) = e~ Kt Xi(t) allows us every- 
where below consider without loss of generality the system U.l\) with k = 0. 

Proof of Theorem [I] 

The first step is the proof of the self averaging property of Af n (\,t), as n — > oo, i.e. 
we prove that for any real A and t > 

hm E^(N n (\,t)-E{M n (\,t)}^ |=0. (3.1) 

According to the standard theory of measure, for this aim it is enough to prove that 
g n (z,t) - the Stieltjes transform of the distribution Af n (\,t) 

9n(z, t) = J = n -i g _J__ ( cfc o), (3.2) 



for any z : ^z ^ possesses a self averaging property, i.e. 



lim E 



g„(z,t) - E{g n (z,t)} 



(3.3) 



where Qz is the imaginary part of z. We prove (13. 3p by using a standard method, based 
on the martingale differences. This method was proposed initially in [3, [TT] to prove the 
self averaging property of the free energy of the Sherrington-Kirkpatrick model of spin 
glasses. We use it in the form: 
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Theorem 4 Consider the function f(£i, . . . , £„) / : 



Dfc-iH Vv p 



I, where ^ e 



K.^ are independent random vectors. If for any k = l,...,p there exists a function 
ipk{£ii ■ ■ ■ i Cfc-i) £k+v ■ ■ ■ £p) (independent of ^ k ) and such that 



E 



then 



E 



p- 1 f(^,...,Q-E{p- l f(^,...,Q} 



' fe=i 



(3.4) 



(3.5) 



Proof of Theorem [7] 

This theorem was proven in [TP] , but since the proof is very simple we repeat it here 
for the sake of completeness. Denote E k the averaging with respect to the random vectors 
£i, . . . , E p — E and E means the absence of averaging. Then it is evident that 

v 

p-'f^i, E{p- l f{l^ . . . ,g> = p- 1 ]T a,, 

k=l 

where 

A fc = Euiffa, ...,£,)}- . . . ,y }. 

Since evidently for < j E{A k Aj} = 0, we obtain immediately that 



E 



p- 1 f(Zi,---,L)-E{p- 1 f(Z 1 ,...,L)} 



P 



-2 



<2p- 2 j2 E { 

k=l ^ 

+ 2p- 2S t E { 
k=l ^ 



k=l 



Ek{f{t 1 ,---,Z,)-Mtl,--;tp)} 



Ek-l{f{ti,--;Q-Mtl,--;tp)} 



h v 
\<Ap-^Ck- 

' k=l 



Theorem H] is proven. □ 

Now we use Theorem 0] for the proof of (13.31) . Then p = n, £ k = (Wki, • • • , Wk n ) and 
/ = ng n (z,t). 

Let us take 



I 



ixf\t)- z - 



where xf\t) are the solutions of the system 

x' = A (fc) x, x(0) = c, (3.6) 

with the matrix A^ k \ whose entries coincide with Ay, if i 7^ k, j 7^ k and are equal to 
zeros otherwise. It is evident, that ipk does not depend on (W&i, . . . , H4 n ). So we are left 
to prove the bound (13.41) . Due to the symmetry of the problem it is enough to prove (13.41) 
for k = 1. 

According to the standard theory of differential equations, considering the terms 
Aj\Xi(t) as known functions, we can write for j — 2, . . . , n 

rt n 

Xj (t) = (e tAW c) j + / Y'(e^ AW ) ji A a x 1 (s)ds = xf\t) + A j (t). (3.7) 

J ° i=2 

Let us represent 

1 1 _ Aj(t) Affi) 

xf(t) - z - z (xf\t) - zf (xf\t) - z)\x 3 (t) - z) 

Then, using this representation for all terms of — ng n (z,t)), except the first one, we 
write 

V>i -ng n (z,t) = -— i ^ + / + // (3.8) 



and 



t rt 



E{\lf} = E\ j [ j d Sl ds 2 Yl ,„(D^ ^7 l gl(ai)gl(a2) 



C Jt- S1 )AW\. . 4. / (t-aaJA^K . A 
el ^ r n n rt rt 

ds\ds2 

ji , h A 1 >*2 =2 , j£ , i'j ,i 2 =2 
(i-s^A^N 4 /„(t-s 2 )A( 1 )\ 4 f P (*-*i)A (1 h ., ., /I ., , |' p (t-s 2 )A( 1 )\ 4 



wo J I „•„ ,-„ ,„ =9 ,, ,, ,, „_ Jo Jo 

(3.9) 



(*£>(*) - ^) 2 (*£>(*) - ^) 2 (af(t) - ^) 2 (*<?(*) - ^) 2 

Here and below we use notations C (t) for some independent of n positive functions, which 
satisfy the bound C(t) < e ct with some positive t-independent constant c. These functions 
can be different in different formulas. 
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Now, since A^ 1 ) and Xj(t) do not depend on An, the averaging with respect to all 
An gives us that we have nonzero terms in the last sum only if ii,i 2 , i'i,i 2 are pairwise 
equal, e.g., %i = i[, i 2 = i 2 - Then, denoting 

Da 



{x [ -\t)-zf 



3 (xf\ 

after the summation with respect to Zi,^,^,^ we get 



E{\I\ 2 } < C{t)E l / 2 { [ x\{s)ds\E l l 2 ln- 2 V f [ d Sl ds 2 

< C^^l^^^rfsl^l^lDlV*!^ 1 '!!}, (3.10) 

where A T means the transposed matrix of A. Now we use the result of [TJ, according to 
which under condition (12.21) for Hermitian matrix A with i.i.d. complex elements, such 
that Aij = Aji and E{Aij} = 0, -E{|A^| 2 } = w 2 

Prob{||A||>2t i ; + e}<Ce-^ 71 , 1 = 7i = ^ (3.11) 

2(1 + a) a + 4 

So, for non symmetric matrix A we can write A = Ai + iA 2 with A 1 = |(A + A*) and 
A 2 = ^-(A — A*) being Hermitian matrices with i.i.d. elements, satisfying (I2.2p . Then, 
since ||A|| < ||Ai|| + 1 1 A2 1 1 , we can derive from (13.111) that in non symmetric case 

Prob{||A||>4 W + A}<Ce-^, 7 = 71 = ^X1 ^ 12 ) 

2(1 + a) a + 4 

This estimate is rather crude, because it is known that ||A|| — ► 2w, as n — > 00 (see [8], 
|12j . where the large deviation type bounds was found for Prob{||AA*|| > Aw 2 + e} in 
the case a > 2 or (13] for the case — w ± 1). But it is enough for our purposes. 

Remark 4 Inequality A3.12\) allows us to use ||A|| in our considerations like a bounded 
random variables. Indeed, since, e.g., \x\(t)\ < ne*" A " ; denoting P n (X) = Prob{||A|| > 
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Aw + A} and using li3.1S\) . we can write for any fixed t and m,s << n 1 / logn 
E{|xi(t)| m e s||A|1 } < e s(4 ™ +e) £{|a;i(t)rfl(4w + e- ||A||)} 

+ n m E{e {s+mmAll 6(\\A\ \ - 4w - 2e)} < e s{Aw+t) E{\ Xl (t)\ m } + n m [ e (s+mt)x dP n (X) 

< e s ^ w+ ^E{\ Xl (t)\ m } + 0(e- Cnl£/2 ) 

Hence, below we use ||A|| as a bounded variable without additional explanations. 

Using (13.121) and the evident bound \Dj\ < \Qz\~ 2 , we get 

E{\I\ 2 } < C(t)E l/2 ^j\\(s)ds^. (3.13) 

Besides, evidently 

n 

\II\ < |^|- 3 ^A,(t) 2 



J'=2 



l^l" 3 



r r . , 

/ / x 1 (s 1 )x 1 (s 2 )ds 1 ds 2 (e ( *- Sl)A(1)T e(*- S2 ) A(1) ), li2 A nl ^ 2l 

Jo Jo M 2 =2 

r-t n 
<\%z\-H xl^dse^'K-^Wl (3.14) 
Jo 



Thus we get 



E{\II\ 2 } < C(t)E 1/2 !^ J\\{s)ds \. (3.15) 
Now we need the following lemma 

Lemma 1 Under conditions of Theorem^ 

E{x\(t)} < C(t) (3.16) 

and Xi(t) converges in distribution to a Gaussian random variable. 

Proof of Lemma U\ 

Using the first equation in (13.61) for k = 1 and the representation (13.71) . we get 
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X 



J'=2 



where 



Hence 



with 



K n (t -s)=n 1 y^lt 

i,i=2 



= + / dsS n (t — s)xi(s), 
'o 



(3.17) 



(3.18) 



(3.19) 



TT 7 rt£ n£ 

<P(t) = l + y2-%d j (t), d 3 (t)= / dsxf\s), S n (t)= / rfriT n (r) 



Making iteration in (I3.19P we get 



"1 nt ft 
Xl (t) = <f>(t) + dsS rr\t - S)(j)(s) + / dsSfr 1+1) (t - S)X 1 (S) 

m=l J ° Jo 

where n± = [log 2 n] ([x] is the integer part of x) and Sn(t) is defined as 



(3.20) 



S®(t) = S n (t), St\t) = / S n (t - s)^— 1 )^)^. 

Jo 



Since evidently 



p t||A(i)|| _ i / » \ 1/2 

1^(01 < „ A mn (n'T^ 



||A«|| 



it 



i=2 



i=2 ' 



1/2 



K, 



(3.21) 



we have 



\s { r\t)\ < 



K r 



>- 1)! 



and so for any m > 2 



c/s^ m) (t-s)(/.(.' 



< 



K 



m— 1 



(m-2)! 



ds(^(t-s)) 2 



1/2 



o?s </> 2 (s) 



1/2 



Therefore 




( / dsS^\t- s)(j)(s] 



< 



((m-2)!) 



rE 1 ' 2 



ds (S n {t-s)Y 



ds (j) 2 (s] 



£1/2 



j£4(m-l) 

(3.22) 
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But using definitions fl3.18IUI3.19l) and taking into account that and <p(t) do not 
depend on An, we get for any t 

{e TA{1) ) t3 W u W 3 ^j J\\s)ds 

i,j=2 

r 0\s)ds\ < n- A C(t)E\ [ (f)\s)ds\. (3.23) 



i=2 

2 



Hence, it follows from (I3.22p . (I3.23f) and Remark H] that for m < log n 

E {(j/ sS ^^- S ^) 4 } - n ' 2 J^~^ E {fj i{s)dS \ (3 ' 24) 
Similarly, using the trivial bound |xi(t)| < ne*" A ", we get 

e{( t ds Sfr 1+1 \t - s) Xl (s)) X < n* C ^ 1+ ^ < 0(n- 2 ). (3.25) 



(nr!) 4 

Now, using (13.241) and the Holder inequality, we obtain 

E^^J^sStHt-s)^)^ <0{n^)E^Jj\s)ds^, (3.26) 
and so it follows from (I3.20p and (13.251) 

E{xi(t)} < CE{(j)\t)} + 0{n- 2 ) <C + Cn- 1 ^E^j\sxf{s)^j | + 

C (V 1 pE^jjs xf (a)) 2 Y) 2 + Cn- 2 it E {(J* ds x f 4 } + ° (n " 2) ' 

(3.27) 

But 



1 E ^{ ( [ ds x ? oo) } < tn ~" I ds E E ^ x ? (^)) 2 } 

< ^| jT^n" 1 X> sA(1 V A(1 %j < £rf S e 2ts H A(1) ll} < C(t) 



and (13.71) implies that 



E{{xf{t)f}<C{t)E{x%t)} + C{t) \ E{x\{s)}ds 
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Substituting these bounds in f!3.27j) and taking into account that (due to the symmetry 
E{x%t)} = E{xj{t)}, we get 



So 



E{x\(t)} < C(t) + Cifyn- 1 [ E{x\(s)}dt 

Jo 



max Eix^s)} < C(t) + tC^n" 1 max E{xl(s)} 

0<s<t 0<s<t 



Hence, we have proved (13.161) . 

The second statement of Lemma Q] follows from representation (I3.20j) . which now, 
using the bounds (13.251) and f!3.26j) . we rewrite as 

zi(t) = 1 + V\^mdj(t) +r n (t), dj{t) = [ dsxf\s), (3.28) 

where 

dj(t) = J dsxf\s), E{r 2 n {t)} < C{t)n-\ 

Now we can apply the central limit theorem, because dj(t) are independent of {W / ij}" =2 
and, according to the above considerations, 

n n „ t 

^E^K-Wll^Wn- 1 ^ / dsE{{xf{s)Y)} 

3=2 j=2 J ° 

^C^n- 1 ^ dsE{x%s)} = C(t) / ds E{x\{s)} < C(t), (3.29) 

j=2 ^° J° 

so dj(t) satisfy some kind of the Lindeberg condition. Lemma [1] is proven. □ 

Using Lemma [Q, one can easily derive (13.41) from (13.81) . (I3.13P and (I3.15p . Thus, we 
have proved the self averaging of g n (z,t) (13.31) and so also the self averaging of Af n (\,t) 

Hence, we need to study only E{J\f n (\, t)}. But due to the symmetry of the problem 
it is easy to see that 

E{M n (\,t)} = E{9(X-x 1 (t))}- 
So, E{J\f n (\,t)} coincides with the distribution xi(t). But, according to Lemma (TJ Xi(t) 
converges in distribution, as n — > oo, to a Gaussian random variable. So, we are left only 
to find the mean value and the variance of x\(t). 
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Using the bound (see the proof of Lemma [T]) 

E^fJ ds S n (t — s)xi(s) 

< E 1/2 ^j^ds(S n (t- s)f^E l ' 2 ^J^x\{s)ds^ < C(t)n-\ (3.30) 
we derive from (13 . 1 9[) that 

E{x l (t)} = l + 0(n- 1 ' 2 ), (3.31) 

So we have proved (12.41) for k = 0. Now using the remark in the beginning of the section, 
one can easily get (12.41) for any k^O. 
To prove (12. 5p define 

R n {t, s) = E{xi(t)x!(s)} = Eixji^Xjis)}. (3.32) 

Using representation (I3.19P for Xi(t) and Xi(s) and the bound (13.301) . we obtain 

Rn(t, s) = 1 + f [ dt'ds'R^(t',s') + 0(n- 1 ), (3.33) 
Jo Jo 

where we denote 

n 

R£\t,s) = n- iy £E{xf\t)xf\s)}. (3.34) 

3=2 

But from representation (13.71) and the inequality (13.141) we get easily 



\R n (t, s) - J#>(f, S )| < C{s)E 1 ' 2 L- 1 A?(t)j + C^jn-^A 

^ i=9 ' < i=9 



3=2 J K j=2 

<{C{t)+C(s))n-^ 2 . 



Thus, we obtain from (I3.33P the equation 

Rn(t, s) = 1 + f [ dt'ds'Rnit', s') + 0(n- 1/2 ), (3.35) 
Jo Jo 



Iterating this equation, we find easily 



limJaM) = l + E M 7T r (3.36) 



m\m\ 

m=l 
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In particular, 

(wt) 2m 
m\m\ 



^E{x\{s)} = l + Y.^ L T- ( 3 - 37 ) 



m=l 



Now, using (I3.3ip . we get (12.51) for k — 0. Then, using again the remark in the beginning 
of the section, it is easy to obtain (I2.5P for any k. 
Theorem [1] is proven. □ 

Proof of Theorem [H 

The first step here is again to prove the self averaging of A/" n (A), i.e. the proof of (13.11) 
or equivalently (13. 3p . This proof almost coincides with that in Theorem [T] and therefore 
we omit it. The only difference is in the proof of the analog of Lemma [TJ 

Lemma 2 Under conditions of Theorem{J\ 

E{x\(t)} < C(t), (3.38) 

and x\{t) converges in distribution to a Gaussian random variable. 

Proof of Lemma [H 

As in the case of Lemma dj we use the equation, which can be obtained, if we use the 
last n — 1 equations to express Xj(t) (j = 2, . . . , n) via x\(t). 

x'i(t) = V ^xf\t) + / dsK n (t - s)x 1 (s)ds, (3.39) 
p£ n 1 ' 2 J J 

where x^\t) are the solutions of H 3 . 6 1) in the symmetric case with k = 1, 

K n (t) = K° n (t) + K n (t) 

n 

K*(f) = n- 1 5>' A( V" 2 



(3.40) 



i=2 

n n 

K n (t) = n- 1 Yl (e^hWiiWu + n- 1 ^(e^)^ - w 2 ), 

i,j=2,i^j »=2 

and here and below A^ coincides with Aij, if i ^ l,j ^ 1 and is equal to zero otherwise. 
Hence 

Xl (t) = (f){t) + / dsS n (t - s)xi(s) (3.41) 
Jo 
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with 



(j>{t) = 1 + V —%dj(t), dj{t) = / dsxf\s)ds, 

3=2 U ' t 
S n (t) = S° n (t) + S n (t), S°(t)= [ drK° n (r), S n (t) 



(3.42) 



dTK n (r) 



Iterating (I3.4ip n\ times (ni = [log 2 n]), we get 

ni rt 



Xi 



"I ft ft 

(t) = 0(t) + V / S^\t - s)(f>{s)ds + / S^ +1 \t-s)x 1 {s)ds, (3.43) 

m=l ^ ^ 



where Sn(t) is defined in (13.481) and has the same bound (13.211) . Repeating the conclu- 
sions of Lemma [T], we obtain finally 



Xl (t) = 0(t)+ / dsS°(t- s)(j)(s)ds+ / TZ n (t - s)(j)(s)ds + f n (t) 



f n (t)= / S£ ni+1 >(*-s)xi(s)d£ 



(3.44) 



where similarly to (I3.25P 

E{f*{t)} < 0(n- 2 ) 

and we denote 

^(*) = £^™>(t), 

m=l 

s { y\t) = s?M s { °> m \t) = [ t s:(t-s)s^ m - l \s)ds 

Jo 

and lZ n (t) is the kernel of the remainder operator, which satisfies the bound 



(3.45) 



E 



dsTZ n {t - s)(j>{s) \ <C{t)E 



-a/2 



ds (s n (t - s)y 



(3.46) 



Here and below we use the result of pQ, according to which in the symmetric case under 
conditions (J2HJ, (Q the bound fl3TTD is valid. 

But, using definitions (13.401) . (13.431) and taking into account that A^ 1 ) does not depend 
on An, we get for any t 

E[{Snit)f) <C(t)n~ 2 . (3.47) 
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2 ^ \ 2 

1)/ 



Hence, we derive from (13.441) and the fact that K®(t) does not depend on A a that 
E{xj(t)} < C(t) (V 1 j^E^jjs x ? 

+ C{t)n- 2 ^E^j^dsxf{s)\ \+0{n- 2 ). (3.48) 



i=2 



3=2 

Then the bound (I3.38f) follows by the same way as in Lemma [TJ 

The second statement of Lemma [2] follows from representation (I3.44p . by the same 
way as in Lemma [H if we observe that 

t 

0/ 



Xl (t) = (j)(t) + / ds Sl(t - s)(j){s)ds + r n (t) 



o 



(s) )+r n (t), (3.49) 



= 1 + f ds S° n (t -s)+J2^T2 ( d M + f ds S°n(t ~ *)dj 

J— 2 

where dj(t) and 5°(t) are independent of {Wh}z = 2 n , S®(t) is bounded and 

^(f)} < C(t)n-\ 

The analog of the Lindeberg condition follows from (13.291) . 
Lemma [2] is proven. □ 

Now, the proof of the self averaging property of g n (z,t) (13. 3p and so also the self 
averaging property of J\f n (\,t) ( 13. ip is similar to the proof of Theorem [U 

Hence, we need to study only E{J\f n (\ £)}■ But due to the symmetry of the problem, 
E{Af n (\, £)} coincides with the distribution Xi(t). And since, according to LemmaH xi(t) 
converges in distribution to a Gaussian random variable, to prove Theorem [2] we are left 
to find 

n 

a s , n (t) = E{(e tA c)i} = £{(e tA )n} + J>{(e< A )i;} 

U (3.50) 

a s , n (t) = E{x\{t)}-E 2 {x 1 {t)} 
Let us use the Cauchy formula, valid for any symmetric matrix A, 

(e tA ) lj = j dze zt G lj (z)dz, (3.51) 
17 



where G(z) = (A — z)~ l is the resolvent of the matrix A and the contour L is taken in such 
a way to contain inside the interval [— 2w,2w], and the distance from L to [— 2w,2w] is 
more than some constant d. According to the result pQ (see f)3.1ip ). then with probability 
more than 1 — e~ Cdnl all eigenvalues of A are inside the contour and the distance from 
any of them to L is more than d/2. Hence with the same probability formula (13.511) is 
valid, and 

Prob{||G(z)|| < ^VzGL} > l-e~ Cdn \ (3.52) 
We use also the following representation of the resolvent G(z): 

(n \ -1 n 

i,V=2 ' i=2 

where G (1) (^) = (A^ — z) 1 is the resolvent of A' 1 '. Hence, we can write 

n , v —1 n 

J^Gij = lw 2 ~g n (z) + r n (z) + z) ^ G ?i A n> ( 3 - 53 ) 

3=2 ^ ' i,j=2 

where 

n 
i=2 

n n 

i=2 i,i'=2,i^i' 

Using that G^(z) does not depend on An, and (13.521) is valid also for ||G^(2;)||, it is 
easy to get 

E{\r n {z)\ 2 } < CtT*e{ £ \G$> (^)| 2 } + Cn-^E^ |>«(^) * G«(Z))«} < Cn\ 

(3.54) 

Hence, it follows from (I3.53p . that 

< j=2 > i,j=2 > 

- Eir n {z){w 2 ~g n {z) + z)" 1 {w 2 ~g n {z) + r n {z) + z))- 1 ]T Cf)A x \ =1-11 (3.55) 
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Since G^(z) and g n (z) do not depend on An, 1 = 0. Besides, since 

\{w 2 g n {z) + z)- l \,\(w 2 g n {z) + r n {z) + z)Y l \ < ||G||, 
combining the Schwartz inequality with (I3.54p . we obtain 

|//| < CE^L- 1 (G (1 \ z ) * }e 1/2 {K(z)\ 2 } < Cn- 1 ' 2 

So, it follows from fl330D - fl335l) that 

n 

Y, E {(e tA h} = 0(n- 1/2 ) (3.56) 
i=2 

and so 

a s>n (t) = E{(e tA ) u } + O^n- 1 ' 2 ) = n~ x E{Tt e tA } + 0(n- 1 ' 2 ). 
Hence, according to the results of [14J , we get 

lim a sn (t) = a s (t) = / e xt \fAw 2 - \ 2 d\ 

n^oo 2TTW J_ 2w 

and so we have proved f]2 .6f) for k = 0. Using remark in the beginning of the section, now 
it is easy to obtain (12.61) for k^O. 

To find a sn (t) let us observe that, due to the symmetry, 

n n 

E{x\(t)} = n- 1 E i^)} = n ~ l E E ^ tA ^} 

n 

= n- 1 E{(e 2tA ) tJ } = EKe^c),} = E{x x {2t)} 

Now it is easy to obtain (12.71) for any k. 
Proof of Theorem [3] 

The proof of the fact that A/"„(A,t) is a self averaging quantity and coincides in the 
limit in the distribution of Xi(t) is the same as in Theorem [TJ [2j Thus we are left to prove 
only that x\{t) can be represented in the form (12.101) in the non symmetric case or (12.111) 
in the symmetric case. 

19 



In the non symmetric case we get similarly to (I3.28p . that 

Mt) = & + J2^K<i}(t)+rn(t), dj(t)= / dsxf\s), (3.57) 

where 



dj(t)= / dsxf\s), E{r 2 n (t)}<C(t)n- 1 
Jo 

and since dj(t) are independent on W\j and £1 and satisfy the inequality (13. 291 we obtain 
that the second sum converges in probability to a normal random variable with zero mean 
and the variance 

o*{t) = lim n _1 V E{d 2 At)} (3.58) 

Now, let us denote 

R n (t, s) = E{xi(t)xi(s)}. 
Then repeating the conclusions (I3.33p - (l3.37p of Theorem [fl we get from (13.41) 

1 + V (3.59) 
z — 4 m\m\ J 

m=l / 

Hence, by (13.581) and the symmetry of the problem, we get 



/ / dt 1 dt 2 R(t 1 ,t 2 ) = w 2 y2—— (3.60) 

Jo Jo m^i m - m - 



So, we have proved (I2.10p in the case k = 0. Then, using Remark [21 we obtain (I2.10p for 
any k. 

To prove (12.111) we use the analog of (13.491) which in the case of (12.81) has the form 
xi(t) = 6 (l + £ ds S° n (t -s)^j+J2^ (dj(t) + jT ds S° n (t - s)d J (s)^j + r n {t) 

j=2 

= s n (t)Ci + z n + r n (t), E{r 2 n (t)} < C{t)n~\ (3.61) 

where dj(t) and S®(t) are independent of {Wu}™^, S®(t) is bounded and dj(t) satisfy 
(I3.29p . Thus, according to the central limit theorem, z n converges in distribution to a 
Gaussian random variable, independent of £i. Besides, s n (t) is a self averaging quantity. 
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To prove this it is enough to prove that S°(t) is a self averaging quantity. The last 
statement follows from the representation (I3.45j) . if we know that S®{t) is a self averaging 
quantity. But, by definitions (13.421) and (I3.40p and the spectral theorem, 

S° n (t) = [ drn^Tre^ = [ dr [ e XT dN*(\) 
Jo Jo J 

where 

n 
8=1 

is a normalized counting measure of eigenvalues of A^. So, the self averaging of s n (t) 
follows from the self averaging of M* (A), which is a well known result (see, e.g. [J4] or 
the review paper [TO]). 

Thus, to finish the proof of (12. lip we are left to find E{s n (t)} and the variance of z n 
in (l3i)il . But, (l3i)il implies that 

E{s n {t)} = w^Eixxit)^} + 0{n- 1 ' 2 ), E{z 2 n } = E{x\{t)} - £ 2 { Sn (t) + 0{rT l ) 

(3.62) 

So, using the fact that Xi(t) is a solution of (11.11) with the initial condition (12. 8p . we get 

n 

n 

= E{ei}E{(e tA )n} + E 2 {^} £ E{{^) v } (3.63) 

i=2 

No, using (13.561) . we get 

E{s n (t)} = £{(e' A ) n } + Oin- 1 / 2 ) = rT^Tr e tA } + 0(n- 1 ' 2 ). 
Hence, according to the results of [14], we get 

lim E{s n {t)} = / e x W4w 2 - X 2 d\. 

n-*oo 2%W J_ 2w 
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To compute E{z 2 }, we write, using that Xi(t) is a solution of (11. ip with (12.81) and taking 
into account the symmetry of the problem, 

n n 

i=i i t j=i t i^j 



n n 



E{&)E{{e^) n } + E 2 {^}n^ £ £ £{(e< A k(e tA ) fcj } 



^{(e 2tA )ii} + ^ 2 te}^- 1 £ E i^ tA )^- ( 3 - 64 ) 



But, according to (13.561) the second sum in the r.h.s of fl3T6ip is 0(n~ 1/2 ). And so, using 
the above consideration, we have 

lim E{x\{t)} = E{g} lim ^^{Tr e 2tA } = / e 2A V4u> 2 - A 2 dA. 

jwoo n-»oo 27TU7 J _2 W 

Finally, we obtain 

7/ ,2 / i /-2«) \ 2 

lim = / e 2X W4:W 2 - X 2 d\-w 2 — / e A V4w 2 - X 2 d\ = w 2 a s (t). 

n~>oo 2nw J__2w \2nw J_ 2w J 

(3.65) 

Now, relations (I3.6ip - (l3.65p imply (12. lip for k = 0. Then, using Remark [31 we obtain 
( gXED for any «. 
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